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Abstract. We propose a general scheme in which disordered systems are allowed 
to sacrifice energy equi-partitioning and separate into a hierarchy of ergodic sub- 

^y^ ' systems (clusters) with different characteristic time-scales and temperatures. The 

details of the break-up follow from the requirement of stationarity of the entropy 
of the slower cluster, at every level in the hierarchy. We apply our ideas to the 
Sherrington-Kirkpatrick model, and show how the Parisi solution can be derived 

C^ ' quantitatively from plausible physical principles. Our approach gives new insight 

into the physics behind Parisi's solution and its relations with other theories, 
numerical experiments, and short range models. 
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PACS numbers: 64.60.Cn, 75.10.Nr, 64.70.Pf 



The Parisi scheme |l[ for rephca symmetry breaking (RSB) has been one of the most 
celebrated tools in the description of the 'glassy' phase of disordered systems. It 
was initially proposed as the solution for the Sherrington-Kirkpatrick (SK) model 
lO \ Pi for spin glasses, but it has since then been successfully applied to a wide range 

of models. The physical interpretation of Parisi's solution has been the subject of 
many discussions, and has generated notions such as hierarchies of disparate time- 
scales P, effective temperatures [0, low entropy production pj and non-equilibrium 
^S \ thermodynamics |g, [7|. Central is the idea of multiple temperatures, which are usually 

defined via the violation of fluctuation-dissipation relations; this often limits studies 
C^ \ to very specific models where correlation- and response functions can be calculated 

Q ■ explicitly. In this letter, in contrast, we present and derive a general scheme in which 

disordered systems are allowed to sacrifice full energy equi-partitioning by separating 
autonomously into a hierarchy of ergodic sub-systems with different characteristic 
Q \ time-scales; the statistics at every level (including effective temperatures) follow from 

O ' the 7i-theorem with constrained (i.e. stationary) entropy. When applied to the SK 

model, our scheme is found to yield the Parisi solution and to generate and connect the 
above concepts in a transparent way. Our assumptions are simple and natural, and all 
ingredients of our theory have a clear physical meaning. Our study proceeds in three 



S ■ distinct stages. First we show generally how and why multiple temperatures can arise 

in disordered systems. We then show how this generates replica theories with nested 
levels of replication, with dimensions reflecting ratios of temperatures. We apply our 
ideas to the 'benchmark' disordered system, the SK model, and derive Parisi's solution. 
We close this letter with numerical evidence for the existence of multiple disparate 
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time-scales, a summary of the simple physical picture that naturally emerges from our 
scheme, and a discussion of the points which need further investigation. 

To understand the origin of multiple temperatures in a system of stochastic vari- 
ables (T = (iji, . . . , CTjv) with Hamiltonian H(cr) and state probabilities (or densi- 
ties) p{(t), we turn to Boltzmann's H-function H — Ti-q- p{cr) {H{cr) +riogp(cr)}, 
which decreases monotonically under standard Glauber or Langevin dynamics and is 
bounded from below by the free energy of the Boltzmann state. For the case where 
we have two groups of variables (fast vs. slow), i.e. a = (crf,crs), we substitute 
p{(T{, (Ts) = p{(T{\crs)p{(Ts) and find 

n = Tr pia,) {iJeff(Ts) +Tlogp{(T,)} (1) 

ilcff(cr,) = Tr picT i\cT s) {H {a f, a s) +T log p{(Ti\(Ts)} (2) 

In the case where cTs and erf evolve on disparate time-scales, the minimisation of (|l]) 
will occur in stages. First, for every (fixed) cts the distribution p{<Ti\crs) of the fast 
variables will evolve such as to minimize (H), i.e. towards the Boltzmann state 

p{cTi\cTs) = Zf\rTs) e-''^('^-'^=) Zf (<T.) = Tr e-'^^^^-'^^) (3) 

Finding multiple temperatures requires, in addition to disparate time-scales, 
stationarity of the entropy of the slow system (on the relevant 'glassy' time- 
scales). Now (Q) is minimised subject to the constraint that the entropy Sg = 
— Ticr^ p(crs) logp((Ts) be kept constant, giving 

p{cTs) = Z-'e-^"^"^'^^'> Z, = Tr e-Z^^ofK^.) (4) 

i.e. a Boltzmann state for the slow variables, with the free energy of the fast ones 
acting as effective Hamiltonian, and at inverse temperature (3 — rhj3. This leads to 
an m-dimensional replica theory, since combining (0,0,0) gives Zg — Tr(7-jZf(crs)]'". 
The dimension rh follows from demanding the prescribed value of the slow entropy: 
pm,^{dJ-s/dm) = Ss, with Tg = —f3~^ logZg. For T > T the fast variables would start 
acting as a heat bath for the slow ones, so thermodynamic stability requires m < 1. 
Note that to < 1 implies that the contraining entropy must be larger than that of the 
Boltzmann state (indeed, a large characteristic time scale does not imply low entropy). 
The above argument can be generalised to an arbitrary hierarchy. The variables 
CTe at each level £ are characterised by distinct time-scales and temperatures {ti, Pi} 
{£ = 0,1, . . . , L); each level being adiabatically slower than the next, Tg <C r^-i. This 
leads to replicating recursion relations for the partition sums at subsequent levels: 

Z, ^ Tr^, [Z,+i]™'+^ {£ < L) 

Zl = Tr^, e-'3-^«'^» 

with m£ — P£_i/Pi < 1, and (3^ = /3. The replica dimensions rhi follow from 
the prescribed (stationary, but as yet unkwown) values Si of the level-£ entropies, 
via Pi+ifiij^^ld^Fe/drhe+i) = Si, with J^i = — /37 logZ^. Equivalently, using the 
specific nesting of the partition functions in (||) one shows that the {rht} are uniquely 
determined by the identities 

/3,+ito2 — ^^„ = S, ^i^{{...{Se)e-i...)i)o (6) 
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in which (• • ■),. denotes the average over the equihbrated level-r process. Due to 
the constrained minimisations underlying (S), the free energies J^i are generally not 
minimised; however, one can verify that Tq still serves as a generator of observables: 



iJ(W)-i7(W) + AV.(W) 



This generalises a formalism originally developed and applied for spin systems with 
slowly evolving bonds [^ . The construction reverts back to the conventional statistical 
mechanical picture if the constraining entropies Se are identical to those of the full 
Boltzmann state: then the constraining forces vanish and rhi = 1 for all i. 



We now apply this scheme to the SK model B, for which the Parisi solution 
was originally constructed, which describes N Ising spins with the conventional 
Hamiltonian H{(t) — ~J2i<j Jij'^i'^j: but with suitably scaled independent random 
couplings Jij (with average Jo/N and variance J/\/N). We assume, following our 
previous arguments, that this system can be viewed as a hierarchy of L + 1 levels of 
spins, each level (. with distinct disparate time-scales and temperatures {rg^Ti}: 

L 

{l,...,iV}= IJ/f, o-=(cro,...,o-L), (Ti = {aj\jeh} (8) 

with |/^| = etN , and such that T( <^ r^-i for all i (thus larger values of £ correspond 
to faster spins). The selection of time-scales for the spins is expected to depend on 
the realisation of the couplings, but here we will make the simplest approximation: 
the system can only choose the relative level sizes {ei\. A study of the autonomous 
selection of levels will be presented elsewhere B . We calculate the disorder-averaged 
free energy Tq (the general multi-level generator of observables) with the replica trick 



•^0 == -/5o logZo 



' lim 



(n/3o)-MogZo" 



(9) 



Together with the relations (H), this leads us to a nested set of nW^^^rht replicas. 
A spin at level t thus carries a set {a\( = {ao,..,a£} of replica indices, where 
ao € {l,..,n} reflects the disorder average, and with a£ € {l,..,m£}. As before 
rh( = Pi^i/ P( < 1. Following standard manipulations, the asymptotic free energy per 
spin / = limjv^oo ^o/N is then found to be 



/ = lim — — cxtr 



2«2 



J^0 






- ^ e<i log K-i 



e=o 



JCf 



Tr exp 



J2/32 



E 






(j{a}e^{b}e 



Ml.Wl 



(10) 



(11) 



>}i 



Extremisation is to be carried out with respect to the order parameters (zKi , whose 
physical meaning is given by (with averages denoting the multi-temperature statistics) : 

*t-.iL-.^EE(-r^-r) (12) 



With the new definitions me = Jlfc=£ "^fe ~ Pt-i/P we obtain (3()h — j3n, and the 
connection with the original Parisi solution becomes clear. What remains is to assume 
full ergodicity within each level in the hierarchy of time-scales: 

'i{b}l^m{'^}L,{b}L] (13) 
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Figure 1. The ultra- metric tree, which here is a direct consequence of the 
hierarchy of spin clusters, evolving at disparate time-scales. 



where £[{a}L, {^Jl] denotes the slowest level for which the the two strings of replica 
coordinates {aji and {6}l differ. Insertion of (O) into (pO|) gives 



/3J2 



/-^E 



e=o L 



1 , ■^ 



where 



aa; 



I J Dzr[Af^+^]''^^^ for r<£ 

[ 2 cosh( J/3m£+i X)!=o Zs^/Qs -Qs-i) for r = .^ + 1 
The physical meaning of qi is 



<?£ 



hm -— > 



JV^oo A^ 



cr.7 L 



^-1 •• ;o 



(14) 
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in which • • • denotes the disorder average. The physical saddle-point is the analytic 
continuation of the one which minimises / for positive integer values of {n, 771^}. For 



such values, the minimum with respect to the e^ (with ^^ 



,££ 



1), in turn, is found 



to occur for {e^ = 1, e^ = V£ < L}, i.e. in the thermodynamic hmit the slow spins 
form a vanishing fraction of the system as a whole. We have now exactly recovered 
the L-th order Parisi solution. The values of the me follow from m), which translates 
into 

^ -/ = E,/iV (17) 



^"^'^'d^e 



The bounds < limAr^oo ^e/N < e£log2 subsequently dictate that, as e^ ^ for all 
i < L, determining 771^ via (O) simply reduces to extremising / with respect to me, 
thus removing the need to know the values of the constraining entropies Se. 

We have thus shown that the Parisi solution can be derived from simple physical 
principles, and can be interpreted as describing a system with an infinite hierarchy of 
time-scales where a vanishingly small fraction of slow spins act as effective symmetry- 
breaking disorder for the faster ones. The vanishing of the fraction of slow spins 
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indicates that the cumulative entropy of the slow spins is sub-extensive, and that the 
so-called complexity is zero. A block-size mi at level i of the Parisi matrix is found to 
be the ratio of the effective temperature T^ of that level and the ambient temperature 
T. Extremization of the free energy per spin with respect to mi is equivalent to saying 
that the average entropy of the spins at level £ — 1 is stationary and sub-extensive. It 
follows from physical considerations (no heat flow in equilibrium) that mi < 1 for all 
i. Ultra-metricity (see fig. ll) is a direct consequence of the existence of a hierarchy 
of time-scales. At each level £, the different descendants of a node represent different 
configurations of the crp^i , which share the same realisation of the disorder and of the 
slower spins. 

Since our proposal relies fundamentally on the existence of clusters with widely 
separated characteristic time-scales, we sought to provide independent evidence for 
this assumption by measuring the distribution Psimi f,t) of the number of flips / per 
spin at time t in numerical simulations of the SK-model, see fig. |^. Upon assuming 
an independent characteristic time-scale tj for each spin Uj, and a distribution W{t) 
for these time-scales, one obtains a simple theoretical prediction for this distribution: 

Pti,{f,t\W) ^ ^°°dr W{r) Q) -^ {l-^y-f (18) 

Minimising the deviation X]/=o [Psim(/, i) — Pth{f,t\W)] with respect to the W{t) 
yields an estimate of the most probable distribution of time-scales W* (r) , see fig. ||, 
which clearly supports our assumptions. Both the number of peaks (in agreement 
with full RSB), and the separation between the peaks (in agreement with infinitely 
disparate time-scales) are found to grow with increasing system size and/or time, 
whereas the fraction of 'slow' spins appears to decrease with increasing system size. 

In fig. H we sketch the qualitative picture emerging from our interpretation of the 
Parisi scheme. Most spins evolve at the fastest (microscopic) time-scale, at ambient 
temperature T; a small fraction evolves at (infinitely) slower time-scales, at higher 
effective temperatures. Cooling to a temperature Ti <T, followed by heating back to 
T, will leave spins with Tcff > T unchanged, explaining memory effects. Conversely, 
after heating to T2 > T and cooling back to T, the original states of spins with 
T < Teff < T2 will be erased, which may explain thermo-cycling experiments (for a 
recent review see e.g. 0). We expect the qualitative features of our picture to 
survive in short range systems, where the time-scales need not be infinitely disparate 
due to activated processes. The origin of the slow time-scales of these clusters must lie 
in the latter being coupled much stronger internally, than (effectively) to the rest of 
the system. They could therefore be seen as a 'soft' version of the fully disconnected 
clusters which give rise to so-called Griffiths singularities in diluted systems ||l^. In 
short range systems, the clusters would have to be spatially localized, in line with 
the droplet picture proposed by Fisher and Huse [|2|. In such systems, each of the 
different levels would correspond to multiple localised spin clusters. The fact that the 
characteristic time-scale of a cluster increases with Tcff — T explains why the effective 
age of a system at temperature T is found to decrease upon spending time at Ti < T, 
but to increase upon doing so at T2 > T. 

At a theoretical level, a more careful treatment of the selection of clusters is clearly 
needed (and is currently being carried out ||]), both for full- and 1-RSB models. This 
may allow us to calculate the complexity in such systems. Furthermore, it needs 
to be investigated whether slow clusters survive above the thermodynamic spin-glass 
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Figure 2. Upper graph: distribution of the number of flips / per spin for 
a simulation of the SK-model with N = 6000, during t = 10 Monte-Carlo 
updates per spin, after a waiting time of t^, = 6.10^, at T = 0.25. Lower graph: 
corresponding estimate of the most probable distribution W*(t) of time-scales t. 
Inset: the small t area enlarged. 



temperature Tgg. Our results also suggest further numerical experiments for both mean 
field and short range models, concentrating on quantities such as spin flip frequencies, 
avalanches, spatial correlations, and cluster persistency EJ 
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Figure 3. Qualitative sketch of the distribution W{Tgf{) of (effective) 
temperatures (note: time-scales increase with T^ff) at ambient temperature T 
(rcsp. Ti, T2) in the spin glass phase. 
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